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Traditionally,  intelligence  gathering  has  involved  three  areas  of  technology:  sensor  and  signal  processing, 
database  technology  and  evaluation  technology.  The  current  pace  of  globalisation,  the  rapid  penetration  of 
Internet  usage  and  continuing  advances  in  sensor  sophistication  mean  that  vast  amounts  of  information  are 
being  gathered,  as  never  before.  Traditional  intelligence  processing  methods  are  feeling  the  strain. 

MEDAV  GmbH  is  a  developer  of  intelligence  processing  hardware  and  software.  For  the  past  20  years, 
we  have  been  engaged  in  studies  and  commercial  projects  for  the  German  Federal  Armed  Forces  and  for 
other  German  and  international  government  agencies.  Our  business  is  to  predict  and  respond  rapidly  to  the 
needs  of  the  intelligence  community.  The  current  trends  are  clear: 

1)  An  increasing  variety  of  sensors  are  being  distributed  over  larger  and  larger  areas.  The  problem  is 
not  just  the  amount  of  information  being  collected  but  the  diversity  of  it.  The  challenge  is  to  find 
meaningful  ways  to  integrate  diverse  information.  Humans  are  not  as  good  at  data  analysis  as 
computers  but  they  are  excellent  at  pattern  recognition.  The  two  should  be  allowed  to  complement 
one  another.  A  visualisation  tool  should  present  data  in  a  way  that  allows  humans  to  recognise  the 
patterns  within  it  -  as  opposed  to  presenting  only  pre-defined  patterns.  Visualisation  software  that 
does  not  allow  users  to  apply  their  own  pattern  recognition  intelligence  is  self-defeating. 

2)  The  Internet  explosion  means  that  open  source  intelligence  (OSINT)  is  becoming  as  important  as 
the  traditional  HUMINT  and  SIGINT.  Thus  we  require  language  processing  and  document 
processing  software  to  complement  the  signal  processing  software  already  available.  In  particular, 
tools  for  the  visualisation  and  summarisation  of  text  are  required.  Another  consequence  of 
internationalisation  is  the  necessity  to  incorporate  Unicode  capability  into  software.  However  the 
multitude  of  ad  hoc  solutions  to  script  encoding  already  in  existence  will  continue  to  persist  in  the 
future  despite  the  adoption  of  Unicode. 

3)  To  cope  with  information  overload,  it  will  be  necessary  to  integrate  more  closely  the  three 
domains  of  information  acquisition,  storage  and  processing.  In  particular,  automated  evaluation 
will  be  required  closer  to  the  point  of  acquisition  in  order  to  filter  at  an  early  stage  the  mass  inflow 
of  irrelevant  information.  Fikewise,  storage  must  be  more  closely  coupled  to  evaluation 
technologies  in  order  to  give  users  easy  and  intuitive  opportunities  to  interact  with  their  data. 

4)  In  the  intelligence  environment,  information  is  usually  incomplete.  For  example,  the  resources 
necessary  to  resolve  ambiguous  or  missing  words  may  not  be  available.  And  context,  which 
allows  information  to  be  interpreted,  may  also  be  incomplete.  Such  cold  start  situations  are  typical 
in  military  intelligence.  The  conclusion  is  that  information  processing  algorithms,  which  are  able 
to  process  incomplete  and  fuzzy  information,  will  become  the  norm. 
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The  rapidly  changing  needs  of  the  intelligence  community  place  severe  constraints  on  the  development  of 
software  solutions: 

1)  Hardware  and  software  must  be  modular,  so  that  parts  can  be  regularly  updated  without  disrupting 
the  whole.  Modules  must  communicate  through  standard  interfaces.  Modularity  allows  a  building 
blocks  approach  to  the  construction  of  complex  functionality.  Because  effective  visualisation  tools 
tend  to  have  long  development  times  and  therefore  high  costs,  modularisation  will  be  essential. 

2)  It  is  better  to  have  generic  modules  that  can  be  configured  by  the  user  for  varying  situations  as 
they  arise,  rather  than  specific  solutions  for  specific  situations.  The  user,  rather  than  the  factory, 
should  be  able  to  reconfigure  a  visualisation  tool,  for  example,  so  that  it  operates  interactively  in 
one  situation  but  automatically  in  another.  Open  architectures  and  the  ability  to  modify  software 
are  preferable  to  proprietary  black-box  solutions.  However,  visualisation  tools  tend  to  be  task 
specific.  The  challenge  will  be  to  find  ways  of  developing  generic  visualisation  tools. 

3)  Solutions  to  intelligence  problems  involve  compromises.  In  the  real  world,  it  is  necessary  to  make 
do  with  what  one  has.  Complex  algorithms  developed  in  the  ideal  world  of  the  research  laboratory 
may  not  be  practical  in  a  world  of  limited  resources.  It  is  easy  to  be  blinded  by  hi-tech  solutions 
when  simpler  solutions  may  be  more  practical. 

4)  Many  of  the  problems  confronted  by  the  intelligence  community  are  also  faced  by  large 
commercial  operations,  for  example  media  and  finance  organisations.  It  is  better  to  use  COTS 
tools  where  these  are  available,  rather  than  “re-invent  the  wheel”.  COTS  products  make  sense  if 
they  reduce  costs  and  inventory  without  compromising  quality  and  security. 

Over  the  past  20  years,  MEDAV  has  developed  integrated  intelligence  processing  packages,  that  acquire, 
automatically  evaluate,  archive  and  interactively  evaluate  both  signals  and  text  documents.  The  archive  is 
the  hub  of  the  architecture.  Automatic  evaluation  serves  two  purposes  -  it  filters  out  the  mass  of  irrelevant 
information  but  it  also  serves  to  enrich  the  incoming  signals  or  documents  with  annotations  that  assist 
subsequent  evaluation. 

Different  processing  and  visualisation  modules  can  be  incorporated  into  this  general  architecture 
according  to  need.  In  studies  with  the  German  Federal  Armed  Forces,  we  have  developed  a  variety  of 
speech  processing,  text  processing  and  visualisation  tools.  While  it  is  true  that  “a  picture  tells  a  thousand 
words”,  we  find  that  users  need  to  have  different  views  over  the  same  data.  For  example  a  graphical 
display  of  a  military  command  structure  can  be  usefully  complemented  by  a  simple  tabular  display  of 
other  information.  However,  neither  display  by  itself  is  adequate.  As  another  example,  a  graphical  content 
summary  of  a  text  document  may  be  useful  if  the  document  is  large  but  for  small  documents  (or  parts  of 
documents),  the  user  may  prefer  textual  summaries. 

It  is  helpful  to  distinguish  three  types  of  display;  1)  traditional  static  predefined  displays,  2)  augmented 
reality  displays  (where  interactive  iconic  and  textual  information  are  embedded  in  realistic  terrain  images, 
for  example)  and  3)  virtual  reality  displays  (where  the  user  becomes  part  of  the  image).  We  still  have 
much  to  learn  about  how  to  use  all  three  effectively.  The  development  of  effective  visualisation  tools 
depends  on  a  keen  understanding  of  the  psychology  of  vision.  The  conclusion  is  that  the  results  of 
fundamental  research  into  human  visual  processing  must  be  fed  into  software  development  projects. 


14-2 


RTO-MP-105 


1 u 

NATO 

3! 

OTAN 

Approaches  to  the  Evaluation  of  Intelligence 


SYMPOSIA  DISCUSSION  -  PAPER  NO:  14 

Author  Name:  Dr.  Ing.  Hans-Joachim  Kolb,  MEDAV,  Germany 

Question: 

What  statistical  pattern  recognition  is  being  used  in  regards  to  email? 

Author’s  Response: 

No  features  concerning  content  of  the  messages  are  being  used,  just  behavior,  such  as  time  elapsed  from 
getting  an  email  to  answering  it,  or  the  size  of  the  message. 

Question: 

Is  there  any  special  storage  or  computing  being  used  for  the  high  volume? 

Author’s  Response: 

No.  If  you  calculate  how  much  space  you  need,  you  find  you  can  get  a  great  deal  of  data  on  one  disk. 
If  you  are  successful  in  finding  an  area  of  interest  in  an  image  it  makes  sense  just  to  keep  the  area  of 
interest. 
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Visualisation  should  generate  an 
environment  supporting  the  perception 
process  of  presented  information. 

Visualisation  should  help  average  users  to 
produce  better  results  and  help  the  "artist 
to  become  more  creative. 


|(5I  NT  makes  contributions  to  describe  the 
tbation  for  military  and  political 
decision-makers  on  the  basis  of  information 

«tercepted  from  communication  and  signal 
stribution  processes. 
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